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ABSTRACT 



Children often have difficulty developing debugging 



skills. This may be attributable to inrtructional methods that 
discourage reflection on one's reasoning errors. Logo ins>:ruction may 
encourage such reflection. Two studies examined Logo's effect on 
confirmation bias — tne tendency to select confirming over 
disconfirming information to prove an hypothesis. One study viewed 
elementary s-cadents while t*e second investigated college students A 
third study investigate^ confirmation bias developmentally in grades 
4 through 12. While Logo programming did not significantly effect 
deductive reasoning, elementary students exhibited an unusually high 
tendency to be disconf irmerL while college students were confirmers. 
A significant djfference was found in that twelfth graders more 
frequently selected confirming information than did fourth graders. 
This suggests that elementary students may be less resistant to 
learning self-reflective deougging skills than older students. Also, 
programming instructors may need to generate specific strategies to 
address confirmation bias in older students at the secondary school 
and univeriuty levels. (Author) 
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Children often have difficulty ueveloping debugging skills. This may be attributable to 
instructional methods that discourage reflection on one's reasoning errors. Logo 
instruction may encourage such reflection. Two studies examined Logo's effect on 
confirmation bias - the tendency to select conllrmlng over disconflrmlng information to 
prove an hypothesis. One study viewed elementaiy students while the second investigated 
college students. A third study investigated conffamation bias developmentally, grades 4 
through 12. While Logo programming did not signlflcantty (2. < .05) effect deductive 
reasoning, elementary students e;diibited an unusually high tendency to be 
disconflrmers while college students were conflrmers. A signlflcant difference (c < .05) 
was found in that twelfth graders more -^uently selected confirming information than 
did fourth graders. This suggests that eiementary students may be less resistant to 
learning self-reflective debugging skills than older students. Also, programming 
instructors may need to generate specific strategies to address confirmation bias in older 
students at the secondary school and university levels. 

INTRODUCTION 

Papert (ref 1) noted that students had difficulties developing debugging strategies and 
attributed children's difficulty to instructional methods used in formal schooling. He 
further suggested that experience with Logo could encourage the development of debugging 
skills. Recent research on strategy development suggests that failure to reflect on errors 
may have a significant impact on learning (ref 2). A related phenomenon, confirmation 
bias, has been studied In decision-making research. Wason and Johnsoa-Lalrd (ref 3) 
found that subjects predomlnant.y selected positive or confirming information (rather 
than negative or disconflrmlng information) when testmg the validity of IF p THEN q 
niles. Confirmation bias has been found across a vvlde variety of subjects (e.g., ref 4), 
Papert's observation that children had difficulty reflecting on errors may reflect a bias in 
children's deductive reasoning towards the avoidarce of disconflrmlng information. 
Through formal schooling children may develop a bias for confirming information, 
while debugging requires consideration of disconfirming information. Logo may 
encourage the development of testing skills which reduce the negative affect associated 
with making errors and develop strategies that Include the consideration of possible 
flaws in one's program. 

OUTLINE OF STUDY AND METHODS 

Study 1 Included twenty-six 5th, 6th and 7th grade students from schools in the greater 
Toledo area who A^ere attending a 5 week computer camp on Logo programming which 
met once a weeV. for 2 hours. Study 2 Included 46 college undergraduates enrolled in a 
"Computer Literacy for Educators" course. Study 3 was comprised of 39 public school 
students - 18 from grade 4 and 21 from grade 12. 

In study 1- students received 8 hours of Logo instruction and were admir istered, as a 
pre-test and post-test, a confirmation bias task pattemed after the four-caA-'d selection 
task developed by Johnson-Laird. Legrenzi, and Legrenzi (ref 5). In study 2, the college 
students Ir^^the experimental group (N ^ 24) received 9 hours of Logo instruction, while the 
control group (N = 22) received instruction on integrating computers Into the curriculum. 

Both groups were administered, as a pre test and post-test, the Instrument mentioned 
above. In study 3 each member of the sample received a version of the above cited 
instrument. Study 1 tested the hypothesis. Logo Instruction causes a signlflcant Jhift nn 

*Dept. of EDC:, Bowling Green State University, I . wiing Green, Ohio 43403 permission to repruduce this 
** LogiCon. Inc.. 2800 Indian Ripple Road, Dayton, Ohio, 45440-3696 material has bffn r.-.„NTED by 

Gregg Brownell 



student's reasoning from a confirming to a disconftoilng strategy. Study 2 tested the 
same hypothesis and additionally the following: Adult students will exhibit an initial 
bias for the consid;jratLon of confirming Information. Study 3 tested the hypothesis: 
Twelfth grade students will exhibit a significant tendency to select confirming 
information when compared to fourth grade students. 

RESULTS 

In study 1, no significant differences (£ < .05) were found In data selection strategies 
before and ailer instru^.lon using a chl-square test. In the table below, p, -q represents 
the optimal data selection strategy. Note: 9 students did not complete the camp. 

Table 1 Number of students using optimal data selection strategy 

Did not select p,-q Selecfced p. -q 



Before Instruction 23 3 

After Instruction 14 3 



However, it was noted that 15 of the 26 students (58%) did select disconflrmlng data (--q) 
piior to instruction, a tendency which remained essentially unchanged (10/17 for 59%) 
after instruction. 

In study 2, no significant differences (e < .05) were found in data selection strategies when 
experimental and control groups were compared before and after instruction with two 
chi-square tests. However, when chi-square tests were used to compare the number of 
subjects selecting a confirming choice (p) and a discorifirming choice (-q) both before and 
after instruction, subjects in both groups tendea to avoid disconflrmlng information 
bcth before (x2 (1,46) = 7.53, m < .01) and alter instrucUon (x2 (1,46) - 6.16, p < .05). Table 2 
Illustrates the frequency o. students selecting p and --q before and after instruction. 
Also, a fairly low percentage, both before and after instruction, selected disconfi'ming 
(--q) data (30% before and 24% after). 

Table 2 Undergraduates (all) selecting p, -q before and after instruction 



(p) 


Net Selected 


Selected 


Before Instruction 






Not Selected 


4 


7 


Selected 


28 


7 


After Instruction 






Not Selected 


4 


5 


Selected 


31 


6 



In study 3, a signiftcant difference (x2, (1,39) = 4.17, p < .05) was found between twelfth 
and fourth grade students who made confirming data selections (p, q) as illustrated in 
'^able 3. 

Table 3 Grade 4 vs. grade 12 - conftrming choices (p,q) 





Not Chosen 


Chosen 


TUal 


Giade 4 


11 


7 


18 




(61%) 


(39%) 




Grade 12 


6 


15 


21 




(2^/b) 


(71%) 




TWal 


17 


22 


39 
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DISCUSSION 

The results of study 1 suggest that contact with Logo may need to be longer than nine 
hours to significantly alter student's data selection strategies. A similar finding is in 
order for study 2. Also in study 2, undergraduate students significantly chose to avoid 
disconflrming data both before and after instruction. This is of interest since the 
majority of elementary students in study 1 selected disconfirming data (58% before 
instruction. 59% after). In contrast, only 30% of the undergraduates in study 2 made such 
selections before instruction and 24% afler. While evidence (ref 3, 6) supports that 
students eventually develop strategies that avoid consideration of disconfirming 
information, the results of this study suggest that children can possess strategies that 
include consideration of disconP ming information even after seven years of formal 
education. It would be best to devise methods to help children maintain and develop 
those tendencies, rather than lose them. The results of study 3 further support this 
difference in data selection strategies. Significantly, twelfth graders in study 3 tend to 
choose confirming data more than do fourth graders. This may mean that instructors of 
high school and college-level programming need to address student's confirmation bias 
by using Instructional methods that stress jreflectlng on program logic and errors. Linn 
and Dalbey's (ref 7) study of high school programmers offers some support for this 
suggestion. 

Obviously more research, especially with larger sample sizes, is neeaed. However, despite 
the limitations of this study, some preliminary insights into conflrmation bias and Logo 
have been gained. 
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